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Final  Report 

The  two-choice  diffusion  modei  has  been  appiied  wideiy  in  psychoiogy  and  neuroscience  and  three 
packages  have  been  deveioped  to  aiiow  the  modei  to  be  fit  to  data.  We  decided  to  do  a  systematic 
examination  of  these  packages  aiong  with  an  evaiuation  of  individuai  differences  and  the  effects  of  the 
number  of  observations  on  parameter  recovery.  These  issues  are  criticai  if  the  modeiing  approach  is  to 
be  used  to  assess  individuai  differences.  The  articie  is  100  pages  iong  and  has  received  a  positive 
review  from  the  new  APA  journai  Decision.  It  wiii  require  some  rewriting  to  reduce  the  iength  and  provide 
a  more  gentie  introduction. 

The  project  examined  methods  for  fitting  the  diffusion  modei  to  data.  There  are  three  parts  to  the  paper. 
The  first  part  examines  practice  effects  and  the  abiiity  of  the  modei  to  recover  parameter  vaiues  with  iow 
numbers  of  observations  in  two  experiments  that  have  designs  that  might  be  used  in  practicai 
appiications.  There  is  a  iot  of  stabiiity  in  estimated  parameters  even  with  quite  iow  numbers  of 
observations  which  came  as  somewhat  of  a  surprise.  The  second  part  uses  simuiated  data  with 
parameters  from  the  same  ranges  as  those  in  the  two  experiments  and  examines  recovery  of  individuai 
differences  from  7  different  fitting  methods  (inciuding  4  pubiished  packages).  The  third  part  examines 
bias  and  accuracy  of  parameter  recovery.  For  the  two  designs,  48  sets  of  parameter  vaiues  that  span  the 
range  of  those  seen  in  fits  to  data  were  used  to  generate  64  simuiated  subjects  per  group.  The  modei 
was  fit  with  the  different  packages.  Resuits  showed  that  some  of  the  methods  were  quite  a  bit  superior  to 
other  methods.  Finaiiy,  a  hierarchicai  Bayesian  package  was  used  to  fit  simuiated  data  from  the  second 
(individuai  differences)  study  and  costs  and  benefits  were  examined. 

From  these  resuits,  a  potentiai  user  of  the  modei  can  get  a  feei  for  the  power  of  anaiyses  they  can  get 
from  their  designs.  The  user  can  aiso  determine  what  individuai  differences  they  may  be  abie  to  detect. 

With  Hans  Van  Dongen,  we  compieted  a  study  of  the  effects  of  sieep  deprivation  on  memory,  specificaiiy 
item  recognition  and  associative  recognition  (Ratciiff  &  Van  Dongen,  submitted).  We  picked  these  two 
tasks  because  they  are  used  extensiveiy  in  modeiing  memory  processes,  and  because  past  iiterature 
suggests  that  they  might  be  differentiaiiy  affected  by  sieep  deprivation.  Aiso,  memory  is  a  component  in 
many  practicai  situations,  it  is  important  to  see  how  it  is  affected  in  sieep  deprivation  and  to  see  which 
components  of  the  memory  tasks  are  affected. 

Our  resuits  showed  a  decrease  in  drift  rate  (evidence  used  in  making  the  decision)  and  no  effect  on  the 
other  modei  parameters.  For  exampie,  under  sieep  deprivation,  there  seemed  to  be  no  change  in  the 
amount  of  evidence  the  subjects  required  to  make  a  decision  and  there  was  no  change  in  the  duration  of 
encoding  and  response  output  processes.  A  paper  on  this  is  under  review.  We  have  aiso  performed  a 
simiiar  experiment  on  perceptuai  tasks  and  these  await  time  for  modeiing. 

One  major  effort  has  been  on  driving  tasks.  One  paper  was  pubiished  (Ratciiff  &  Strayer,  2014)  and 
another  is  under  review.  Data  from  two  more  studies  have  been  coiiected  and  initiai  modeiing  done. 
These  oniy  require  time  for  writing  and  finai  modeiing  to  produce  articies  for  submission.  The  aim  of 
these  studies  was  to  show  how  the  decision  modeis  couid  be  appiied  in  experiments  using  simuiator 
environments. 

The  pubiished  paper  appiied  the  one-boundary  diffusion  modei  to  the  data  from  two  experiments  in  which 
subjects  were  performing  a  simpie  simuiated  driving  task.  In  the  first  experiment,  the  same  subjects  were 
tested  on  two  driving  tasks  using  a  PC-based  driving  simuiator  and  the  psychomotor  vigiiance  test  (PVT  - 
a  task  used  extensiveiy  in  sieep  research,  see  Ratciiff  &  Van  Dongen,  201 1 ,  PNAS).  The  diffusion  modei 
fit  the  response  time  (RT)  distributions  for  each  task  and  individuai  subject  weii.  Modei  parameters  were 
found  to  correiate  across  tasks  which  suggests  common  component  processes  were  being  tapped  in  the 
three  tasks.  The  modei  was  aiso  fit  to  a  distracted  driving  experiment  of  Cooper  and  Strayer  (2008). 
Resuits  showed  that  distraction  aitered  performance  by  affecting  the  rate  of  evidence  accumuiation  (drift 
rate)  and/or  increasing  the  boundary  settings.  This  provides  an  interpretation  of  cognitive  distraction 
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whereby  conversing  on  a  cell  phone  diverts  attention  from  the  normal  accumulation  of  information  in  the 
driving  environment. 


In  the  submitted  paper,  an  experiment  is  presented  in  which  subjects  were  tested  on  both  one-choice 
and  two-choice  driving  tasks  and  on  non-driving  versions  of  them.  Diffusion  models  for  one-  and  two- 
choice  tasks  were  successful  in  extracting  from  response  time  and  accuracy  data  measures  of  the  quality 
of  the  information  from  the  stimuli  that  drove  the  decision  process  (drift  rate  in  the  model),  for  the  two- 
choice  model,  the  speed/accuracy  criteria  subjects  set,  and  the  time  taken  up  by  processes  outside  the 
decision  process.  Drift  rates  were  only  marginally  different  between  the  driving  and  non-driving  tasks, 
indicating  that  nearly  the  same  information  was  used  in  the  two  kinds  of  tasks.  The  tasks  differed  in  the 
time  taken  up  by  other  processes,  reflecting  the  difference  between  them  in  motor  aspects  of 
performance.  Drift  rates  were  significantly  correlated  across  the  two  two-choice  tasks  showing  that 
subjects  that  performed  well  on  one  task  also  performed  well  on  the  other  task.  Nondecision  times  were 
correlated  across  the  two  driving  tasks,  showing  common  abilities  on  motor  processes  across  the  two 
tasks.  These  results  show  that  diffusion  decision  modeling  can  be  used  to  decompose  performance  in 
one-choice  and  two-choice  driving  tasks  into  its  underlying  components  and  so  allow  the  loci  of  the  effects 
of  factors  that  impair  driving  to  be  determined. 

In  the  first  study  to  be  written,  there  were  three  tasks.  The  first  was  a  one-choice  task:  drive  into  the 
adjacent  lane  when  the  car  in  front  puts  its  brake  lights  on.  The  second  was  a  two-choice  task:  when  an 
array  of  black  and  white  pixels  appears,  drive  to  the  right  lane  if  it  is  bright  and  the  left  lane  if  it  is  dark. 
The  third  was  the  same  as  the  second  except  instead  of  being  in  a  relatively  featureless  open  road,  the 
car  was  in  a  city  with  buildings,  instructions  to  turn  corners,  and  with  night  time  limited  visibility,  in  other 
words  a  more  complicated  and  distracting  environment.  Results  show  correlations  in  model  parameters 
that  show  consistent  individual  differences  across  tasks  and  the  effect  of  the  distracting  environment  was 
to  reduce  drift  rates,  i.e.,  there  was  poorer  information  from  the  stimulus  with  which  to  make  the  decision 
than  in  the  clear  environment. 

In  the  second  study  to  be  written,  we  performed  a  speed-accuracy  manipulation  with  one-choice  and  two- 
choice  tasks.  This  experiment  has  to  be  modeled  in  detail  yet.  Preliminary  results  show  the  expected 
effects  of  the  speed-accuracy  manipulation  on  decision  criterion  settings. 

I  was  also  involved  in  model  fitting  for  an  experiment  on  the  effects  of  video  gaming  on  decision  making 
(van  Ravenzwaaij,  Boekel,  Forstmann,  Ratcliff,  &  Wagenmakers,  in  press).  Previous  research  suggests 
that  playing  action  video  games  improves  performance  on  sensory,  perceptual,  and  attentional  tasks.  For 
instance.  Green,  Pouget,  and  Bavelier  (2010)  used  the  diffusion  model  to  decompose  data  from  a  motion 
detection  task  and  estimate  the  contribution  of  several  underlying  psychological  processes.  Their  analysis 
indicated  that  playing  action  video  games  leads  to  faster  information  processing,  reduced  response 
caution,  and  no  difference  in  motor  responding.  Because  perceptual  learning  is  generally  thought  to  be 
highly  context-specific,  this  transfer  from  gaming  is  surprising  and  warranted  replication  in  a  large  scale 
training  study.  We  conducted  two  experiments  in  which  participants  practiced  either  an  action  video  game 
or  a  cognitive  game  in  five  separate,  supervised  sessions.  In  the  second  experiment  we  included  a  third 
condition  in  which  no  video  games  were  played  at  all.  Behavioral  data  and  diffusion  model  parameters 
showed  similar  practice  effects  for  the  action  gamers,  the  cognitive  gamers,  and  the  non-gamers  and 
suggest  that,  in  contrast  to  earlier  reports,  playing  action  video  games  does  not  improve  the  speed  of 
information  processing  in  simple  perceptual  tasks. 

We  have  also  developed  a  model  for  the  go/no-go  task.  It  is  a  task  with  a  long  history  in  experimental 
psychology  and  has  clinical  applications.  For  the  Air  Force,  it  is  a  task  that  is  quite  common  in  many 
domains.  For  example,  if  a  stimulus  appears,  the  subject  either  has  to  perform  an  action  or  withhold  any 
response.  In  contrast,  in  a  two-choice  task,  subjects  are  presented  with  a  stimulus  and  are  required  to 
make  one  of  two  responses  based  on  the  stimulus  (e.g.,  is  this  stimulus  bright  or  dark,  was  this  word 
studied  before,  and  so  on. 
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The  model  we  developed  Is  one  In  which  subjects  adopted  two  decision  boundaries  but  did  not  Implement 
one  decision.  The  hypothesis  Is  that  subjects  make  both  decisions  but  do  not  make  a  no-go  response 
and  so  wait  out  no-go  trials  until  time-out  expires.  We  fit  the  go/no-go  model  to  half  of  the  data  from  a 
two-choice  task  (mimicking  go/no-go  data)  and  found  model  parameters  close  to  those  for  the  two  choice 
task  except  for  the  time  taken  for  nondecision  processes  (which  can  be  Interpreted  as:  the  motor 
component  of  processing  Is  faster  for  hitting  one  key  than  for  hitting  one  of  two  keys).  We  fit  go/no-go 
data  from  the  same  subjects  as  the  two-choice  data  and  found  that  drift  rates  were  reduced,  that  Is, 
evidence  from  the  stimulus  had  lower  quality  when  faced  with  a  go  versus  no-go  decision  than  when 
making  one  of  two  responses  to  the  two  choices  In  the  two-choice  task. 

With  Philip  Smith  we  have  continued  Investigation  of  Integrating  models  of  perceptual  processing  with  the 
decision  models  and  a  paper  Is  In  press  from  this  collaboration  (Smith,  Ratcliff,  &  Sewell).  We  have  found 
that  the  speed  and  accuracy  of  discrimination  of  featurally-defined  stimuli  such  as  letters,  oriented  bars, 
and  Gabor  patches  are  reduced  when  they  are  embedded  In  dynamic  visual  noise.  But,  unlike  other 
discrimlnablllty  manipulations,  dynamic  noise  produces  significant  shifts  of  RT  distributions  on  the  time 
axis.  These  shifts  appear  to  be  associated  with  a  delay  In  the  onset  of  evidence  accumulation  by  a 
decision  process  until  a  stable  perceptual  representation  of  the  stimulus  has  formed.  We  considered  two 
models  for  this  task,  which  assume  that  evidence  accumulation  and  perceptual  processes  are 
dynamically  coupled.  One  Is  a  time-changed  diffusion  model  In  which  the  drift  and  diffusion  coefficient 
grow  In  proportion  to  one  another.  The  other  Is  a  release  from  Inhibition  model.  In  which  the  emerging 
perceptual  representation  modulates  an  Ornsteln-Uhlenbeck  decay  coefficient.  Both  models  successfully 
reproduced  the  families  of  RT  distributions  found  In  the  dynamic  noise  task.  Including  the  shifts  In  the 
leading  edge  of  the  distribution  and  the  pattern  of  fast  errors.  We  concluded  that  both  models  are 
plausible  psychological  models  for  this  task. 

We  published  a  new  model  for  multicholce  decisions  and  confidence  judgments  (Ratcliff  &  Starns,  201 3). 
Confidence  In  judgments  Is  a  fundamental  aspect  of  decislon-making  and  tasks  that  collect  confidence 
judgments  are  an  Instantiation  of  multiple-choice  decislon-making.  The  model  was  applied  to  confidence 
judgments  In  recognition  memory  tasks.  The  model  uses  a  multiple-choice  diffusion  decision  process  with 
separate  accumulators  of  evidence  for  the  different  confidence  choices.  The  accumulator  that  first 
reaches  Its  decision  boundary  determines  which  choice  Is  made.  With  this  algorithm,  an  Increase  In  the 
evidence  In  one  accumulator  Is  accompanied  by  a  decrease  In  the  others  so  that  the  total  amount  of 
evidence  In  the  system  Is  constant.  Application  of  the  model  to  the  data  from  an  earlier  experiment 
(Ratcliff,  McKoon,  &  Tindall,  1994)  uncovered  a  relationship  between  the  shapes  of  z-transformed 
receiver  operating  characteristics  and  the  behavior  of  response  time  distributions.  Both  are  explained  In 
the  model  by  the  behavior  of  the  decision  boundaries.  For  generality,  we  also  applied  the  decision  model 
to  a  three-choice  motion  discrimination  task  and  found  It  accounted  for  data  better  than  a  competing  class 
of  models. 

I  also  examined  psychometric  functions  with  the  diffusion  model  (Ratcliff,  2013).  In  the  paper,  the 
diffusion  model  was  fit  to  a  range  of  perceptual  tasks  (1 1  experiments).  Psychometric  functions  for  these 
tasks  usually  plot  accuracy  against  difficulty,  but  for  some  levels  of  difficulty,  accuracy  can  be  at  celling. 
The  diffusion  model  extends  the  range  of  difficulty  that  can  be  evaluated  because  drift  rates  depend  on 
response  times  (RTs)  as  well  as  accuracy  and  when  RTs  decrease  across  conditions  that  are  all  at  celling 
In  accuracy,  then  drift  rates  will  distinguish  among  the  conditions.  Signal  detection  theory  assumes  that 
the  variable  driving  performance  Is  the  z-transform  of  the  accuracy  value  and  somewhat  surprisingly,  this 
closely  matches  drift  rate  extracted  from  the  diffusion  model  when  accuracy  Is  not  at  celling,  but  not 
sometimes  when  accuracy  Is  high.  Even  though  the  functions  are  similar  In  the  middle  of  the  range,  the 
Interpretations  of  the  variability  In  the  models  (e.g.,  perceptual  variability,  decision  process  variability)  are 
Incompatible. 
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